Dynamic many-process applications on many-tile embedded systems and HPC clusters: The EURETILE programming environment and execution platforms

In the next decade, a growing number of scientific and industrial applications will require powerefficient systems providing unprecedented computation, memory, and communication resources. A promising paradigm foresees the use of heterogeneous many-tile architectures. The resulting computing systems are complex: they must be protected against several sources of faults and critical events, and application programmers must be provided with programming paradigms, software environments and debugging tools adequate to manage such complexity. The EURETILE (European Reference Tiled Architecture Experiment) consortium conceived, designed, and implemented: 1an innovative many-tile, many-process dynamic fault-tolerant programming paradigm and software environment, grounded onto a lightweight operating system generated by an automated software synthesis mechanism that takes into account the architecture and application specificities; 2a manytile heterogeneous hardware system, equipped with a high-bandwidth, low-latency, point-to-point 3Dtoroidal interconnect. The inter-tile interconnect processor is equipped with an experimental mechanism for systemic fault-awareness; 3a full-system simulation environment, supported by innovative parallel technologies and equipped with debugging facilities. We also designed and coded a set of application benchmarks representative of requirements of future HPC and Embedded Systems, including: 4a set of dynamic multimedia applications and 5a large scale simulator of neural activity and synaptic plasticity. The application benchmarks, compiled through the EURETILE software tool-chain, have been efficiently executed on both the many-tile hardware platform and on the software simulator, up to a complexity of a few hundreds of software processes and hardware cores. Classifications: 20.100: Embedded Systems; 20.050: Distributed Systems; 30.050: Parallel & Distributed Applications; 30.060: Multimedia & Internet; 30.040: Neural Networks; 10.050: Hardware & Software Co-Design; 10.070: Communication Systems & Interconnection Networks; 20.130: FaultTolerant Computing